AWS Data Pipeline Stock Data Pipeline

Designed and built a data pipeline using AWS to aid data scientists in the creation of financial prediction models. In this project, I used AWS data pipeline and RDS and a host of other AWS services to create a pipeline that took in data from csv files, transformed and processed them before loading them into an RDS database. AWS Lambda was then used to automate the entire process. The list of services used can be seen in the diagram.